THIS  DOCUMENT  IS  BEST 

♦  : 

* 

QUALITY  AVAILABLE.  THE  COPY 
FURNISHED  TO  DTIC  CONTAINED 
A  SIGNIFICANT  NUMBER  OF 
PAGES  WHICH  DO  NOT 
REPRODUCE  LEGIBLY. 


AD  7$$°  ^ 


coitons  O'-  *t*r:«suc-r  improvement  rm> 

* 

Robert  ilhiahko 

;  -  iU'.'nd  Corporurton,  S.w t<?  Monica,  California 


of  eh;  literature  on  optimal  technical  change  or  optimal,  in- 

vantivu  -.■.ctivity  in  economics  has  dealt  with  optimal  accumulation  paths 

] 

or  optical  consumption  paths  and  with  long-run  ateady-state  growth, 
in  the  tcnnaat'KSnt  literature,  emphasis  la  given  to  optimal  control  of 

il-d)  eicoiiasliturea  in  order  to  bring  to  fruition  a  complex  sequence  of 

2 

s ps eifl c  even ta.** 

The  problem  wo  will  be  dealing  with  in  thia  section  has  elements 


oi:  both  apDt caches.  The  decision  is  not  how  much  to  allocate  to  such 
i  .  '  t- 

grandloss  aggregates  as  consumption  or  investment,  but  simply  how  much 

to  put  into  n  particular  R^D  program  at  any  time  ,(a  genuine  management 

problem).  Yet>tbe  problem  is  formulated  in  the  following  way:  given 

a  production  function  for  technical  change  we  seek.  a  path  which  maxi¬ 


mizes  the  present  discounted  value  of  the  difference  between  its 
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benefits  and  coets , (definitely  a  notion  frost  pure  econoalc  theory). 

^  The  nodal  is  developed  within  the  context  of  a  prograa  in  which  an 
organisation  attaapts  to  improve  the  performance  of  one  of  its  ays tana 

<x  v-  £ 

subject  to  an  arbitrary  fiscal  constraint  which  Halts  the  rate  of  RgD 
spending  on  that  system. [  jSuph  a  constraint  la  meaningful  in  a  world 
in  which  limits  of  this  type  are  act  by  a  political  body,  or  by  a 
higher  authority  who  perhaps  has  performed  a  higher  level  of  optimisa¬ 
tion  over  several  projects.  How  this  higher  level  of  optimisation 
ought  to  be  performed  ia  itself  an  important  and  interesting  question. 
Presumably  it  Involves  a  subjective  aaaea ament  of  the  relative  plausi¬ 
bility  of  many  possible  future  states  of  the  world.  As  such,  that  ques¬ 
tion  goes  far  beyond  the  intention  of  this  paper. 

For  those  who  wish  to  think  in  more  concrete  tame,  the  organisa¬ 
tion  can  be  thought  of  as  the  Air  Force  engaged  in  a  product-improve¬ 
ment  program  for  one  of  its  jet  engines.  A  fiscal  .constraint  may  then 
have  been  Imposed  by  the  Air  Force's  chief  RAD  officer,  or  by  Congress 
itself.  We  will  use  this  parable  whenever  it  appears  to  aid  in  the 
presentation  of  the  model. 

Formulation  of  the  Problem 

Let  P(t)  be  an  index  of  performance  of  an  Air  Force  system  at 
time  t,  and  let  U(P(t>)  be  the  utility  flow  at  time  t  from  having  per¬ 
formance  P(t)  available  for  Immediate  incorporation  into  a  piece  of 
hardware.  P(t)  must  satisfy  the  following  condition: 


(1) 


P(t)  <  p(X(t) ,  t) 
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Much  of  the  literature  on  optlaal  technical  change  or  optimal  in¬ 
ventive  activity  in  economic*  haa  dealt  with  optimal  accumulation  patha 
or  optimal  consumption  paths  and  vi^n  long-run  steady-state  growth,1. 

In  the  management  literature,  emphasis  is  given  to  optimal  control  of 

RAD  expenditures  in  order  to  bring  to  fruition  a  complex  eequence  of 
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specific  events. 

The  problem  we  will  be  dealing  with  in  this  section  haa  elements 

of  both  approaches.  The  decision  is  not  how  much  to  allocate  to  such 
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grandiose  aggregates  as  consumption  or  investment,  but  slmplythow  much 
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to  put  into  a  particular  R|D  program  at  any  time, (a  genuine  management 
problem).  Tet^the  problem  is  formulated  in  the  following  wey:  given 
a  production  function  for  technical  change  we  seek; a  path  which  maxi¬ 
mises  the  present  discounted  value  of  the  difference  between  its 
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Table  1 

DEFINITIONS  OF  VARIABLES  USED 


P(t)  *  Index  of  performance  at  time  t. 

X(t)  ■  cumulative  R&D  expenditure*  for  performance  Improvement  up  to 
time  t. 

E(t)  “  USD  expenditure*  for  performance  improvement  at  time  t. 

t  -  time. 

U(')  -  utility  flow  at  time  t. 

9(0  *  maximum  feaalbla  performance  at  time  t. 

E  -  maximum  permlaalble  rata  of  RID  expenditures  for  performance 
Improvement  at  time  t. 

fl  -  rate  of  time  discount  on  expenditures . 

p*  -  rate  of  time  discount  on  utility. 

p  ■  p*-6. 

v  "  rate  of  factor  augmenting  technical  change. 

|i(t)  “  Pontryagln  price  attached  to  cumulative  R&D  expenditures  for 
performance  Improvement  at  time  t. 

e(X)  “  elasticity  of  marginal  utility  with  respect  to  cumulative  R&D 
expenditures  for  performance  improvement. 
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<p( ' )  i*  the  production  function  for  performance  improvement,  and 

lta  principal  arguaent  ia  X(t)  tha  cuanilatlva  R&D  aonay  apant  on  per- 

foraance  improvement  up  to  tlae  t;  t  ltaelf  aay  be  an  arguaent  of  tha 

function  if  for  exaapla  there  ia  factor  augaanting  technical  change. 

Let  us  aaauae  for  now  that  thia  production  function  aatiafiea  modified 
3 

Inada  conditions: 

(2a)  9(0)  -  PQ 
(2b)  <p(“)  «  - 

(2) 

(2c)  tp’  (0)  -  - 
(2d)  <p’(-)  -  0 

Pq  ia  the  performance  level  at  the  beginning  of  the  product-improvement 
program.  In  the  case  of  Jet  engines,  ve  can  take  this  to  be  the  per¬ 
formance  at  the  tlae  of  the  MQT  (Model  Qualification  Test). 

E(t)  ia  tha  rate  of  R&D  expenditures  at  tlae  t,  and  by  definition 
then,  .is  the  rate  of  change  of  X(t).  E(t)  la  constrained  to  be  lesa 
than  E  at  any  time  t. 

The  problem  then  la  to  find  a  path  for  0  <  E(t)  <  E^  and 
P(t)  <  <p(t)  such  that  the  following  Integral  ia  maximized: 

(3)  £  {U(P(t)>  e"p*t  -  XE(t)  e"6(t))dt 

where  p*  and  6  are  the  discount  rates  for  utility  and  expenditures 
respectively. 

The  rate  of  exchange  between  utility  and  expenditures,  X,  can  be 
assuaed  to  be  unity  with  complete  generality  by  the  appropriate  choice 
of  units.  The  optimal  control  problem  can  now  be  written  as: 

3 

This  production  function  for  product-improvement  in  jet  engines  has 
been  statistically  estimated  at  Rand  and  the  estimated  form  does  Indeed 
satisfy  these  modified  Inada  conditions. 
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maximize  f"  (U(P(t))  e"p*C  -  E(t)  e”6t)dt 
(E(t),  P(t)}  0 

subject  to  X(t)  ■  E(t) 

<p(X(t))  -  P(t>  >  0 

E«sx  "  E(t)  *  0 
X(0)  -  XQ  -  0 

<j>(0)  -  Pg 
E(t),  P(t)  >  0 


Dsglvstlon  and  Analysis  of  Necessary  Conditions 

It  Is  clear  from  the  above  formulation  that  It  would  be  Inefficient 
to  choose  a  performance  level  less  than  the  maximum  feasible  as  given 
In  equation  (1).  Hence  we  can  replace  P(t)  in  "lie  integral  by  <p(X) ,  and 
proceed  using  the  Maximum  Principle  of  Pontryagin,  et  al. 

(5)  maximize  J"  {U(»(X))  •~p*t  -  E(t)  e_#t)dt 

{E(t)>  '° 

subject  to  (a)  X(t)  ■  E(t) 

<b)  -  *Ct)  >  0 

(c)  X(0)  -  0 

(d)  P(0)  -  P0  -  q»(0) 

(e)  E(t)  >  0 

Let  |i(t)e~fit  be  the  Pontryagin  price  or  Hamiltonian  multiplier, 
analogous  to  the  Lagrangien  multiplier  in  static  problems.  The  neces¬ 
sary  conditions  for  a  maximum  are  derived  by  forming  the  Hamiltonian, 


H  »  U(9(X))"pn  -  E(t)  e  “6t  +  (iE(t)  e~6t 
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■ad  maximising  H  at  aaeh  point  in  tlaa  with  raapact  to  tha  control 
4 

variable,  E(t).  Thia  implies  tha  following  rulaa: 

If  |i(t)  >1,  aat  E(t)  -  E^ 

If  |*<t>  -  1,  aat  E(t)  e  [0,  1^] 

If  n(t)  >  1,  aat  E(t)  -  0. 

It  la  alao  necessary  that  u(t)  satisfy  tha  following  dlffarantlal 
aquations : 

(7)  |1  -  84  - 

where  H*  la  the  maximized  Hamiltonian. 

(8)  H*(t)  ■  max  H(t) 

E(t) 

Equation  (7)  can  be  reduced  to  a  more  tractable  form: 

(7')  |i  -  Hi  -  U'  <p'(X)  e(p*“6)t 

4 

Assuming  the  maximization  of  H  offers  no  obstacle  to  sufficiency, 
all  we  need  is  the  concavity  of  H  in  the  state  variable  X  to  guarantee 
aufflcient  conditions  for  a  maximum.  We  have  the  following: 

dH 

-  U'<p'>  0  if  U'  >  0  and  <p'  >  0 

•2-f  -  uy  +  (jy  U"  <  0  if  »"  <  0  and  U"  <  0. 

ax'4 

So  concavity  of  <p(-)  and  U(<)  is  more  than  anough  to  guarantee  suf¬ 
ficiency. 
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That  Che  government  should  use  the  seme  rate  of  discount  on  ex¬ 
penditures  (costs)  and  utility  (benefits)  in  a  defense  type  project  is 
questionable.  The  reasons  can  be  summarised  as  follows: 

(a)  the  lack  of  markets  in  which  the  demand  for  public  projects 
like  defense  can  be  evaluated, 

(b)  the  oligopolistic  nature  of  the  supply  side  of  defense 
projects,  and 

(c)  the  dubious  assumption  that  capital  markets  for  private 
projects  of  various  risk  classes  are  themselves  in  equi¬ 
librium. 

What  rate  of  discount  should  the  government  use  on  expenditures?  The 
government  can  Induce  Individuals  to  lend,  funds  voluntarily  at  the 
relatively  low  interest  rate  on  government  bonds.  To  induce  individuals 
to  lend  more  the  government  may  have  to  raise  that  rate,  but  the  cost 
of  capital  to  the  government  Is  usually  less  than  the  prevailing  rate.5 

The  discount  rate  on  utility  the  government  ought  to  use  is  the 
social  rate  of  time  preference  for  that  good.  The  problem  is  com¬ 
plicated  further  by  the  fact  that  there  may  be  a  divergence  between 
private  and  social  rates  of  time  preference,  the  former  being  the  one 


5 This  is  usually  attributed  to  the  need  cm  the  part  of  private 
investors  for  a  risk  premium.  Should  the  government  also  include  such 
a  risk  premium  in  its  evaluation  of  benefits?  The  risk  to  the  govern¬ 
ment  in  the  type  of  projects  we  are  dealing  with  in  this  chapter  (re¬ 
call  our  parable  of  the  Air  Force  investing  in  a  product-improvement 
program  for  one  of  its  jet  engines)  is  not  that  the  production  function 
is  uncertain  (we  have  assumed  it  is  completely  certain)  but  that  the 
utility  function  will  change,  in  other  words,  that  states  of  the  worlds 
will  prevail  in  the  future,  in  which  various  threats  materialise  or 
dematerlallse  that  make  defense  projects  more  valuable  or  less  valu¬ 
able.  Indeed  in  the  case  of  defense  the  utility  of  a  project  depends 
heavily  on  the  actions  of  other  decisionmakers  within  the  context  of 
a  non-zero  sum  game. 

Is  It  not  better  then  to  use  an  "optimistic-pessimistic-best  guess" 
procedure  and  to  weight  the  utility  outcomes  by  the  subjective  proba¬ 
bilities  one  attaches  to  these  different  states  than  to  add  on  an 
arbitrary  few  percent  to  the  minimum  social  risk  discount  rate  to 
account  for  the  real  uncertainty  about  the  future? 
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that  operates  in  securities  markets  for  private  projects.  Ona  a ay 
argua  that  with  dafanaa  tha  benefit#  of  fraadoa  and  independence  that 
fall  upon  future  generation#  #hould  be  valued  nearly  a#  highly  a#  we 
do. 

In  addition,  there  aay  be  "tlma-tlme  preference,"  aeaning  that 
benefit#  to  be  received  in  the  diatant  future  are  not  "discounted"  at 
the  same  rate  as  benefits  to  be  received  in  the  near  future.  When 
individual#  lend  fund#  to  the  government,  they  are  usually  foregoing 
consumption  in  the  near  future.  Defense,  on  the  other  hand,  seam#  to 
be  the  type  of  good  which  ha#  a  large  component  of  long-term  benefits. 

The  argument  that  the  market  rate  of  interest  is  the  one  the 
government  ought  to  use  to  discount  costa  and  benefits  1#  based  on  the 
assumption  that  markets  are  in  equilibrium,  in  particular  that  markets 
for  risk  exist  and  that  they  function  ir  *  reasonably  competitive  manner. 
Clearly  such  an  assumption  is  unwarranted.  Perhaps  we  can  say  that  if 
markets  are  in  equilibrium  and  a  government  project  is  a  perfect  sub¬ 
stitute  for  a  private  project  then  the  rate  of  discount  that  ought  to 
be  used  is  market's  rate  of  Interest  for  that  project.  But  if  a  public 
project  is  not  a  perfect  substitute  for  some  private  project  then  there 
is  no  necessary  relationship  between  the  observed  market  rate  (if  Indeed 
one  such  rate  can  be  chosen  from  the  many  rates  observed)  and  the  dis¬ 
count  rate  the  government  ought  to  use  in  evaluating  that  project. 

Indeed  markets  for  public  goods  of  the  defense  type  generally  do 
not  exist,  and  even  if  they  did  there  is  good  reason  to  believe  that 
the  supply  side  of  such  markets  would  be  ollgopolistlcally  structured. 
Furthermore,  because  of  the  fundamental  problem  of  public  goods  one 
would  rarely  expect  these  markets  to  be  in  equilibrium. 


All  this  leads  Co  the  conclusion  thac  it  nay  ba  socially  optimal 
to  use  different  discount  rates  on  utility  and  expenditures  for  projects 
of  this  type.  Let  p  »  p*  -  6  then  we  can  rewrite  equation  (7*)  as 

(7")  d  -  fin-  U>' (X)  e“pt 

where  p  can  be  positive  (implying  a  greater  diacount  rate  being  applied 
to  utility  than  to  expenditures) ,  sero  (implying  a  common  discount  rate 
on  both),  or  negative  (implying  a  greater  discount  rate  being  applied  to 
expenditures  then  to  utility).  We  will  handle  each  of  these  cases 
separately  beginning  with  the  easiest  and  becoming  progressively  more 
difficulty. 


Case  1:  o  ■  0 


The  optimal  behavior  for  X(t)  and  n(t)  can  be  represented  in  a 


phase  diagram  in  (X,  n)  space.  Such  a  diagram  is  shown  in  Figure  1. 

The  X  »  0  stationary  is  actually  the  region  ((X,  |i)|x  <  0,  u  <  1). 

All  other  points  strictly  above  the  line  |t  ■  1  have  X  -  >  0,  while 

e 

all  points  on  ■  1,  have  X  £  0.  The  £  -  0  stationary  can  be  found  by 


solving  the  equation 


(9) 


H- 


» 


Using  the  concavity  of  U(»)  and  <p(*)  we  have  been  implicitly 
assuming,  U'q>' (X)/g  is  a  positive  and  decreasing  function  of  X.*  The 
value  of  X  which  equates  the  discount  rate  ft  to  the  marginal  utility 
of  another  dollar  of  cumulative  RAO  is  denoted  X*.  Above  the  |i  ■  0 


and 


*"'(•) 


>  0  ere  sufficient  to  guarantee  that  the  rate 


of  decline  is  Indeed  slowing  as  X  gets  larger. 
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stationary  «4-  U'qp' (X)  >  0  and  hence  |i  auat  b«  increasing  over  tine; 
similarly  balow  tha  U“  0  stationary ,  \i  auat  ba  dacreasing  ovar  time. 

Tha  quastion  la  than:  la  thara  a  trajactory  baginning  at  (0,  m-(0)> 
which  can  satisfy  tha  aquations  of  notion  and  tha  trsnsvsrsality  con¬ 
dition  glvsn  as  aquation  (10)? 

(10)  11a  n(t)  s’4t  -  0 

Thara  Is  ona  and  only  ona  such  trajectory,7  and  it  la  tha  one 
beginning  at  (0,  |t*(0))  and  ending  at  (X*,  1).  This  trajactory  la  shown 
in  Figure  1.  All  trajectories  beginning  above  or  balow  |i*(0)  cannot 

O 

satisfy  tha  transversality  condition  (10). 

7Thls  follows  trivially  fron  tha  Lipschltzlan  character  of  tha  dif¬ 
ferential  equatlona  (5a)  and  (7")  describing  the  behavior  of  X  and  |i 
respectively.  To  check  that  these  equations  are  Indeed  Lipachltslan, 
note  that  the  right-hand  sides  of  both  equations  era  twice  continuously 
differentiable  with  respect  to  X,  u,  t  for  all  B(t)  such  that  0  <  E(t) 

<  E  . 

-  max 

®Proof : 

(a)  Suppose  a  trajactory  begins  balow  |**(0),  say  at  ji(0),  then  this 

A  A  A 

trajectory  neats  the  u*l  line  at  a  value  X  and  at  a  tine  T-X/E^  where¬ 
upon  X  ceases  to  Increase  and  the  value  of  p  declines  according  to 
(1)  |1-8U  -  -U'q)' (X)  -  a  constant 

A 

Hence  ji(t)  -  40s&tt“T)  +  U>'(X)/«. 

We  can  solve  for  jig  using  the  condition 

(11)  |»(T)  -  1  -  U0  +  U'<p'(X)/6 
So, 

A 

(iii)  *)  -  (l-U'q)'(X)/«)e6(t"T)  +  U>’(X)/6 

A 

But  now  since  (i  must  be  declining  over  tins  in  this  region,  1  -  U'<p' (X)/6 
must  ba  negative.  It  therefore  cannot  satisfy  tha  transversality  condi- 

A 

tion.  Alternatively,  since  X  <  X*  (see  fn.  7), 
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On  the  optlaal  trajectory  tha  traoavaraallty  condition  becoaes 
(10‘)  11a  n(t)  a"6t  -  11a  1  •  e“6t  -  0 

t-M.  t-*» 

This  la  consistent  with  one's  Intuition:  given  the  concavity  of 

q 

tha  utility  function  in  X,  one  night  guess  that  HAD  funds  should  be 
spent  at  the  aaxlaua  allowed  rate  until  soae  tine  T*  after  which  fund- 

(iv)  1  -  u y  <X)/d  <  1  -  uy  (X*>/«  -  0 

(b)  Consider  the  trajectory  (X(t) ,  n£(t))  which  begins  at  |i*(0)  but 
which  crosses  the  |i  ■  0  curve  with  aaxlaua  control  applied,  l.e. , 

E(t)  »  Then 

(v)  lin  |L*(t)  e“6t  *  0 

since  both  terns  are  non-negative.  On  this  Modified  "optiaal"  trajec¬ 
tory,  at  any  tine  t,  X  »  E^t. 

Suppose  a  trajectory  begins  above  u*(0) ,  say  at  JT(0) ,  than  this 
trajectory  croeaes  the  (1-0  curve;  both  |i  and  X  Increase,  the  latter 

also  according  to  X(t)  -  E _ t .  At  any  tine  t,  the  corresponding  X 

values  are  the  seen  along  the  two  trajectories.  Bence 

(vi)  jl(t)  -  dj(t)  -  «0*(t>  -  |»J(t)) 

Solving  the  above  differential  equation,  we  obtain 

(vii)  n(t)  -  |*J(t)  -  f0e6t 

Where  f^  is  positive  since  it  is  equal  to  JT(0)  -  |t*(0).  Then 

(viii)  lin  u(t)  e“6t  -  ffl  +  lia  nj(t)  e"8t 
t-*«  c-*« 

>  0 

which  does  not  satisfy  the  transversallty  condition. 

®Note  this  is  weaker  than  the  coablnatlon  of  the  concavity  of 
U(»)  in  its  arguaent  and  the  concavity  of  9(0  in  X,  but  is  the  sene 
as  the  concavity  of  H  in  the  state  variable  X  (see  fn.  4) . 
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Ing  stops  altogether.  Finding  sn  optimal  solution  to  this  dynamic 
problem  is  equivalent  to  solving  the  simple  static  problem  of  maximis¬ 
ing  the  difference  between  benefits  end  costs.  The  optimal  total 
expenditure  is  just  the  one  that  equates  the  marginal  benefits  to 
marginal  costs  with  the  marginal  cost  schedule  cutting  the  marginal  bane- 
benefit  schedule  from  below.  This  point  is  precisely  X*;  the  solution 
to  the  dynamic  problem  tells  us  however  that  we  should  endeavor  to  get 
to  X*  as  fast  as  possible. 

Summary  of  Case  1 

Given  the  maximum  problem  (5)  with  p*  ■  6.  optimality  implies  spend¬ 
ing  at  the  maximum  allowable  rate  to  time  T*  given  by  X*/Em^,  where 
uy(X*)  ■  6.  After  T*  spending  should  be  terminated  completely.  The 
final  level  of  performance  is  given  by  <p(X*> . 

Case  2:  o  >  0 

In  general,  stationary  solutions  to  equation  (7')  lie  in  a  mani¬ 
fold  embedded  (X,  |i,  t)  space.  The  manifold  of  solutions  to  u-0 
is  shown  in  Figure  2.  The  optimal  trajectory  in  tills  case  is  char¬ 
acterised  by  a  finite  period  of  maximum  RAD  expenditures  followed  by 
an  infinite  period  of  xero  expenditures  with  a  declining  but  positive 
(i.  Figure  2  also  shows  such  a  trajectory.  The  value  of  X  at  which 
RAD  expenditures  terminate  is  denoted  X**. 

It  remains  to  show  that  the  proposed  trajectory  can  comply  with 
the  transvarsallty  condition  of  equation  (10).  Suppose  along  the  pro¬ 
posed  optinal  trajectory  it  could  be  demonstrated  that  the  point  (X**, 
|i(t))  was  always  below  the  |l(t>  -  0  stationary  for  all  t  >  0,  and 
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4 (c)  was  able  to  approach  aero  just  slowly  enough  so  as  to  remain  posi¬ 
tive  except  in  the  limit  u  t  +  «,  then  the  equations  of  motion  and 
transversality  condition  could  both  be  satisfied.  Now  when  11  falls  to 
unity,  R&D  expenditures  terminate,  and  equation  (7”)  becomes 

(11)  |l(t)  -  *i(t)  -  uy(x**) 

where  T**  ■  Since  uy (X**)  is  just  a  constant,  the  solution 

to  (11)  is  just 


(12)  „<t>  -  ♦  “V««  .-*<*-«**> 

Pick  ii  (0)  such  that 

(13)  nQ  -  [1-uy  (X**)/(p+6)]e_6T**  -  0, 

that  is,  the  point  X**  is  just  the  one  which  satisfies  |ig|opt.  traj. 

so 

„<t) .  'W  .-p(t-i-) 


Further, 

(15)  lim  n(t)  e"6t 

t-*« 


11m 

t-Ml 


O'm  '(X»»)  -p(t-T**)-«t 

p+« 


0, 


-  U,  PVW»)  t+pT** 

f  P* 

-  0 

Define  ii**(t)  to  be  the  value  of  ii  which  makes  |l(t)  ■  0  for 
X  -  X**. 

Thus 

(16)  U**(t)  -  SUf&L  #-p(t-T**) 

Now  sines  p  has  been  assumed  to  be  positive,  we  have 

(17)  0  <  n(t)  <  n**(t) 
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This  la  precisely  what  was  needed  to  show  tha  optlaallty  of  tha  pro- 
poaad  trajectory  of  Figure  2. 

Summary  of  Caaa  2 

Givaa  nl—  problem  (S)  with  p*  >  6  optimality  implies  spending 
at  tha  maximum  allowable  rata  to  ti—  T**  glvan  by  T**  “ 

Aftar  T**  apandlng  ahould  ba  tarmlnatad  eonplataly.  Tha  final  level 
of  parforsanca  la  glvan  by  qp(X**) .  A  fortiori,  I**  <  T*  and  X**  <  X* 
for  p  rob  lam  having  tha  a  am  utility  and  production  functions. 

Caaa  3:  o  <  0 

This  la  tha  mat  complex  and  lntar eating  of  tha  three  caaaa.  In 
certain  altuatlona  there  will  ba  a  "turnpike"  aolutlon  In  which  tha  rata 
of  BAD  expenditures  la  positive  but  lass  than  or  equal  to  tha  maximum 
allowable  rata;  cumulative  BAD  expenditures  my  or  my  not  ba  finite. 

In  othar  situations  tha  optimal  solution  la  to  spend  at  tha  main—  allow¬ 
able  rata  for  all  tlm. 

To  start  with,  recall  aquation  (7"). 

(7")  *  -  flu  -  UV<X)  «~pt 

Mow  however  -p  >  0  and  |1  •  0  stationary  la  constantly  shifting 
upward.  Suppose  for  now  tha  slope  of  the  utility  function  becomes  mo 

A# 

at  som  finite  point  <p(X) .  Than  Flgura  3a  below  depicts  tha  behavior  of 
tha  |1  ■  0  stationary  over  tlm. 

Tha  optlaal  trajactory  begins  somewhat  above  tha  p  ■  1  line  and 

e 

novas  In  accordance  to  aquation  (7")  and  X  •  until  it  just  "catches 
up"  to  tha  £  -  0  stationary.  In  Flgura  3a  this  tlm  is  shown  as  t  •  tj. 
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The  optimal  trajectory  then  moves  along  the  u  ■  1  line  at  a  rata 
of  MD  expenditures  so  as  to  remain  on  the  n  ■  1  line  with  |i  ■  0  as 
cumulative  expenditures  Increase.  In  other  words,  optimal  expenditures 
are  just  enough  to  keep  pace  with  the  apparent  rightward  movement  of 
the  £  •  0  stationary  at  u  ■  1.  This  is  the  so-called  "turnpike"  path. 
Eventually  u  t  +  *  the  |i  ■  0  stationary  becomes  a  vertical  line  anchored, 
as  are  all  the  ji(t)  -  0  stationeries,  at  X  ■  X.  It  is  apparent  that  BAD 

sea 

expenditures  should  not  go  beyond  X  since  marginal  utility  is  aero  and 
the  Integral  In  aquation  (5)  can  only  decrease.  Yet  RAD  expenditures 
do  not  abruptly  terminate  as  they  do  in  the  other  cases;  here  they 
eventually  taper  off  to  sero  as  the  |1  ■  0  stet ionary  reaches  the  vertical 
position  only  in  infinite  time.  The  transversal! ty  condition  is  easily 
satisfied. 

(18)  lim  u(t)  e-6t  -  lin  1  •  a~4t 

t-M»  £*• 

-  0 

e 

He  can  compute  the  optimal  value  of  E(t)  -  X  (t)  during  the  "turnpike" 
phase.  At  any  time  t  >  t^,  |i(t)  •  0  and  p(t)  -  1,  and  equation  (7")  becomes 

(19)  0  -  A  -  UV(X)  e~pt 

This  is  an  implicit  function  of  X  and  t,  and  application  of  the  Im¬ 
plicit  Function  Theorem  yields 

(20)  0  -  pUV(X)  e’pt 

+  (U"(q>'(X))2  +  U>' (X))  Xe"pt 
or 
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Define  the  elasticity  of  marginal  utility  with  respect  to  cumula- 

i 

tlvo  R4D  expenditures  as 


(22) 


■rdff.y)  4-. 

ax  uy 

u" 

-  -  [Jr  <p(X)  + 


So  equation  (23)  becomes 


Thus  if  the  "turnplka"  trajectory  is  to  be  feasible,  we  require 


that 

(24) 


lie  X(t)  -  0 


In  order  for  equation  (24)  to  hold  it  is  necessary  that 

(25)  lie  e(X)  -  - 
X*X 

Suppose  now  we  relax  the  earlier  assumption  on  the  utility  function. 
The  |1  ■  0  stationary  does  not  reach  a  limiting  position  u  t  ♦  so 
along  the  optimal  trajectory  cumulative  expenditures  do  not  stop  at  some 
finite  amount.  The  rate  of  HAD  expenditures  on  the  optimal  trajectory 
may  or  may  not  tapar  off  to  zero,  and  there  may  or  may  not  be  a  "turnpike" 
phase  in  the  solution. 

Which  of  these  situations  holds  depends  basically  on  the  feasi¬ 
bility  condition  given  in  equation  (23).  Figure  3b  shows  three  possible 
optimal  trajectories.  The  absolute  value  of  p»  the  else  of  and  the 
elasticity  function  determined  which  of  the  three  optimal  paths  shown 
is  the  solution  for  a  particular  problem. 

Consider  path  I.  The  optimal  trajectory  "catches  up"  to  the  jl  -  0 
stationary  at  time  t  •  t^,  and  then  moves  along  the  |*  -  1  line  at  a  rate 


/////// 

f1  <f2<f3 


Fig  .3b— Optimal  trajectoriei  for  p<0  with  U#>0  everywhere 
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•o  a*  to  tana In  always  on  the  u  •  0  atetlooery.  To  do  this,  X  must  be 
Increasing  at  the  rata  given  by  equation  (23)  which  holds  for  t  >  t^. 
That  is, 

<“’>  *  '  iffr  x  *  E.~ 

In  particular,  if  (23*)  is  satisfied  initially  and  e(X)  is  strictly 
convex,  then 

(26)  11a  X(t)  »  11a  *  0 

t***  t  **• 

If  c(X)  Is  a  linear  hoaogeneous  function,  that  la,  if  e(X)  •  bX,10 
then  equation  (23')  becoaes 

(23')  X  •  -£■  «  a  constant 

If  -p/b  <  then  a  "turnpike"  solution  is  feasible  for  t  >  t^, 
end  X(t)  »  E_av  tj  +  (-p/b)  (t-tj).  In  this  case  the  rate  of  BID 
expenditures  do  not  taper  off  to  aero  as  t  ®. 

It  aay  be  possible  for  equation  (23*)  to  be  satisfied  only  for  a 
finite  period  of  tlae  after  which  X  must  grow  at  a  rate  greater  than  E  ^ 
in  order  to  stay  on  the  turnpike.  The  optimal  trajectory  must  leave  the 
turnpike  at  this  tine  with  p  greater  than  one  and  increasing  according 
to  equation  (7")  and  X  increasing  at  the  rate  .  In  Figure  3b  this 
la  shown  as  optimal  path  II;  the  "turnpike"  phase  begins  at  t  -  t2  and 
ends  at  t  ■  tj.  Optimal  path  III  occurs  when  equation  (23')  can  not  be 
satisfied  for  any  time  interval.  It  remains  to  show  that  these  paths 
can  satisfy  the  transversallty  condition,  and  this  we  do  below.  The 
argument  is  similar  to  Case  1  in  which  p  >0;  p,  however  is  increasing 
Instead  of  decreasing. 

*®An  example  of  this  condition  is  U’qp’  (X)  •  a  for  X  >  X  and 

a  >  1.  Then  c(X)  •  X  In  a  »  bx. 
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Let  the  time  when  4  starts  rising  bs  T* ,  than  aquation  (7")  become: 

(27)  |l  -  fti  -  UV<X(t)) 
where  X(t)  -  X(T*)  +  Emav(t-T*) . 

Let  |i*(t,  X(t))  be  the  value  of  4  which  ukee  tf(t)  -  0  at  X(t),  than 

(28)  4*(t,X(t))  <  n*(t,X(T*))  -  “WiK1*??  «-*<*-*•> 

since  |i(T*,X(T*))  -  4*(T*,X(T*))  and  iKt,X(t))  >  |l*(t,X(T*))  for  t  >  T* 
we  must  have 

(29)  4(t,X(t))  >  4*(t,X(T*))  >n*(t,X(t)). 

What  this  shows  is  that  4(t)  can  incraase  fast  enough  to  remain  always 
above  the  |1  stationary  as  both  4  and  X  Incraase.  Furthermore,  let  JT(t) 
be  the  solution  to  the  related  differential  equation 

(30)  4  -  84  -  UV(X(T*))  e“p(t“T*) 

Hence  4(t)  ■  U  ^  •  Fick  IT(0)  (which  by  neces¬ 

sity  must  be  greater  than  4(0)  such  that  4Q  -  [{T(T*)  -  U'^' (X(T*))/(p+6)le~®T 
-  0.  Using  aquations  (27)  and  (30): 

(31)  |l(t,X(t))  -  4(t)  -  6[4(t,X(t))  -  4(t)]  +  [U>'(X(T*))  -  U>* (X(t)) ]e"p(t‘T*) 
and  by  taking  limits  as  t  -*•  •,  we  obtain 

(32)  0  -  6  X(t))  -  4(t)]  +  p g  [U>'(X(T*))-U>’(X(t))]e'»»(t"T*) 

or 

(33)  lim  4(t,X(t))e"6t  -  lim  4(t)e”6t  -  j  limtU’^' (X(T*))  -  D>'(X(I*) 

t-"»  °  t-H» 

+  !„„(«*))]  e“P(t-T*)-6t 

-  0 

Thus  the  transversallty  condition  can  also  be  satisfied. 
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Siinnr  of  Cm  3 

Given  maximum  problem  (3)  with  p*  <  6,  optimality  1*  achieved  bp 
one  of  the  following  program*:  (a)  a pending  at  the  maximum  allowable 
rate  for  all  time  t  >  0;  (b)  spending  at  the  marl  nun  allowable  rate  for 
all  but  e  finite  period  of  time;  or  (c)  spending  at  the  narimum  allowable 
rate  for  a  finite  period  of  time  followed  bp  an  infinite  period  with  a 
positive  and  posslblp  declining  rate  of  expenditure. 

The  likelihood  of  program  (a)  increases  (at  the  expense  of  programs 
(b)  and  (c))  as  (1)  the  divergence  between  p*  and  6  increases;  or  (2) 
as  E|ux  becomes  smaller;  or  (3)  as  marginal  utility  becomes  less  responsible 
to  Increases  in  X. 

Factor  Augmenting  Technical  Change 

Let  us  introduce  factor  augmenting  technical  change  in  the  production 
function  for  performance  improvement  bp  making  its  argument  X(t)  evt 
where  v  can  be  either  positive  or  negetlue.  If  we  assume  6  is  the  common 
discount  rate  on  utllltp  and  expenditures,  then  maximum  problem  (5)  can 
be  written 

(34)  maximise  J*  {U^Xe*))  -  E(t)>  e'5tdt 
subject  to  (5a)  -  (5e). 

For  practical  applications,  we  nap  be  more  concerned  with  the  ease 
v  <  0.  This  has  the  interesting  interpretation  as  an  exogenous  decap 
in  the  fruits  of  R&O  expenditures  such  as  an  inability  to  preserve  RAD 
results.  This  could  be  due,  for  example,  to  rapid  turnovers  in  RU> 
personnel. 
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A1  tentatively  the  case  v  >  0  could  correspond  to  advances  in  basic 
research  with  direct  application  to  the  project  et  hand. 

The  rules  Cor  choosing  E(t)  remain  unchanged  but  the  differentlel 
equation  describing  the  behavior  of  p  becomes: 

(35)  |i  -  -  OV<XaVt>  «Vt 

Define  Y  to  be  emulative  augmented  R&D  expenditures,  that  is,  Y  ■  Xevt 
then  equation  (35)  has  precisely  the  same  form  as  equation  (7")  with  v 
taking  the  place  of  -p.  Ve  can  take  advantage  of  this  similarity  by 
analysing  this  problem  in  (Y,ji)  phase  space  instead  of  (X,|0  phase  space. 

e 

The  transformation  from  X  to  Y  gives  rise  to  e  Y  ■  0  stationary  obtained 
by  solving 

(36)  Y  -  Xevt  +  vY 

-  E(t)eVt  +  vY 

E  evt 

If  |i(t)  >  1,  Y  -  -=5~— 

If  u(t)  •  1,  Y  -  --^gV  ,  0  <  E(t)  <  Zm 
If  l£)  <  Y  ■  0 

Again  ve  must  distinguish  two  cases  corresponding  to  v  ^  0.  Only 
if  v  <  0  will  pert  of  the  Y  ■  0  stationary  be  in  the  positive  quadrant  of 
the  phase  diagram  in  (Y,n)  apace.  We  will  handle  each  of  these  cases 
separately. 

Case  1:  v  <  0 

The  optimal  program  in  this  case  is  qualitatively  similar  to  Case  2 
(p  >  0)  of  the  previous  section.  Optimality  is  achieved  by  spending  at 
the  maximum  allowable  rate  till  some  time  T*  after  which  expendlturee 
stop  altogether.  Cumulative  R&D  expenditures  remain  fixed  but  cumulative 
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&&D  expenditures  augmented  by  the  factor  avt  decline  to  aero  at**. 

e 

Figure  4  shows  the  |i  »  0  sad  Y  ■  0  stationeries  in  (Y,  p,  t)  phase  space. 
Along  the  optimal  trajectory  p  also  approaches  sero  at  t  +  ■,  thus 
satisfying  the  transversal! ty  condition.11 


Case  2:  v  >  0 

In  this  case  the  entire  positive  quadrant  of  the  phase  diagram  in 

e 

(Y,|i)  space  is  e  region  of  Y  >  0.  The  sat  of  optimal  programs  is  qual¬ 
itatively  similar  to  the  set  of  optimal  programs  in  Case  3  (p  <  0)  of 
the  previous  section.  But  because  Y  has  an  exogenously  exponentially 
growing  tern  it  is  more  likely  that  a  "turnpike"  solution  can  be  found 
in  which  the  control  is  gradually  curtailed.  In  combination  factor 
augmenting  technical  change  and  different  discount  rates  may  work  in  the 
same  direction  or  they  may  oppose  each  other.  The  final  solution  will. 


11 


The  brief  sketch  of  the  proof  would  be  as  follows: 
Let  g(Y,t)  -  U>'(Y)ev(t"T*>,  then  for  t  >  T* 

(i)  "  (1-Cj)  vg  where 


<“>  i --***» 


Y 

VTyT 


is  the  elasticity  of  marginal  utility  with  respect  to  cumula¬ 
tive  augmented  BAD  expenditures.  Mote  that  by  assumptions  already  made 

11m  e.  (Y)  -  0. 

Y-*0+ 

Mow  by  equation  (i) ,  is  bounded  by  vg  and 

(ill)  |i  -  ft*  -  UV(Y)ev(t_T*)  <  fip  -  g*  e  v(t_T*) 

0 

where  p<T*)  -  gg/fl  -  1  and  |1<T*)  -  0.  Thus  for  t  >  T*,  |l(t)  <  0  and 
4(t)  >  +  *  W*  5  ®  violat¬ 

ing  any  previous  condition,  then  lim  i*(t)  •  0. 
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o£  court* ,  depend  on  the  relative  etrengths  of  theae  two  effects. 

Soae  Coaaents  on  the  Cases  so  Far: 

1.  One  question  we  are  tempted  to  aak  Is  how  Is  this  aaterlal 
useful.  First,  It  can  suggest  within  the  very  nodes t  level  of  detail 
of  the  aodel  how  R&D  prograas  ought  to  be  run.  As  such  the  aodel  Is 
a  normative  one. 

Second,  we  aay  wish  to  compare  the  predictions  of  the  aodel  with 
soae  observed  behavior.  For  exaapla ,  it  la  laatructlve  to  ask:  given 
the  types  of  solutions  of  the  aodel,  what  asauaptions  about  parameters 
and  behavioral  rules  give  the  solution  that  best  reflects  the  actual 
behavior  In  Air  Force  product-improvement  prograast  The  cess  thet  seems 
aost  applicable  is  Case  3a  In  which  the  aarglnal  utility  after  soae 
level  of  performance  Is  precisely  aero  and  utility  Is  discounted  over  tiae 
at  a  rate  less  than  expenditures. 

The  result  Is  that  the  rate  of  expenditures,  while  beginning  at  the 
aaxlaua  alloweble  level,  gradually  tapers  off  to  xero.  Although  this 
tapering  off  takes  Infinite  tine,  soae thing  we  presumably  do  not  observe 
In  the  real  world,  It  Is  possible  to  explain  the  apparent  truncation  of 
expenditures  by  taking  into  account  Che  fact  that  after  a  certain  amount 
of  tine,  the  optimal  level  of  expenditures  Is  saall  In  comparison  to  the 
real  world  cost  of  arranging  for  funding  with  the  fiscal  authorities. 

That  Is  to  say,  the  effect  of  bargaining  costs  associated  with  procuring 
funds  Is  to  cause  an  abrupt  teralnation  of  expenditures  even  though  the 
optimal  prograa  In  the  absence  of  such  bargaining  costs  calls  for  continu¬ 
ing  the  prograa,  albeit  at  a  low  level. 
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Th«  assumption  of  Case  3a  chat  U'  -  0  aftar  iom  lavcl  of  par fora- 

mm 

anca  P  can  logically  arisa  froa  a  ballaf  Chat  althar  Cha  anaay'a  each- 
oology  can  ba  coaplataly  daalc  with  uaing  only  P,  or  that  should  a  caps- 
bility  graatar  than  P  ba  nasdad  an  antlraly  diffarant  way  of  countaring 
tha  thraat  would  bacoaa  chaapar. 

Tha  othar  assumption  of  Case  3a  that  p*  <  6  seams  reasonable  in  light 
of  the  observed  behavior  of  tha  military  organisations.  (Ha  have  to  rely 
on  these  observations  since  there  are  few,  if  any,  statements  on  this 
subject.)  Typically  they  exhibit  a  high  discount  rate  in  their  desire 
for  resources,  and  at  the  same  time  they  seen  to  encourage  the  use  of  a 
low  discount  rate  in  the  evaluation  of  their  output,  l.e.,  defense  or 
more  specifically,  deterrence. 

He  can  carry  this  line  of  reasoning  further.  Because  our  pollcital 
process  determines  the  sise  of  our  defense  budgets  rather  than  a  market 
mechanism,  within  the  DoD  as  a  whole  and  within  each  military  service, 
there  is  a  shadow  price  associated  with  discretionary  capital  expendi¬ 
tures  which  acts  as  an  opportunity  cost  of  capital.  This  shadow  price 
on  capital  expenditures  in  the  military  may  bear  no  relation  to  the  oppor¬ 
tunity  cost  of  capital  in  the  "outside  world."  It  could  be  that  this 
opportunity  cost,  6*,  is  used  by  the  military  services  to  discount  expendi¬ 
tures  in  maximum  problem  (5)  instead  of  the  socially  optimal  discount 
rate  6. 

Furthermore  what  6*  is  would  presumably  depend  on  the  overall  size 
of  the  defense  budget  (or  each  Service's  budget):  the  more  austere  that 
budget,  the  higher  6*.  In  a  world  of  austere  budgets  most  likely  fewer 
projects  would  be  funded,  but  for  those  that  were  funded  (keeping  in  mind 
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Chat  va  art  Calking  about  projects  which  can  ba  correctly  described  by 
the  model,  e.g.,  product-improvement  projects),  following  the  optimal 
program  would  mean  carrying  the  project  for  a  longer  period  than  one  would 
optimally  under  a  less  austere  budget. 

Indeed  if  the  military 'a  'khadow"  opportunity  cost  on  capital  expendi¬ 
tures  is  greater  than  the  socially  optimal  discount  rats  on  expenditures, 
6,  then  projects  In  the  military  will  either  be  carried  too  long,  or  too 
much  money  will  be  spent  on  them,  or  both. 

2.  One  of  the  Implicit  assumptions  made  In  the  model  Is  that  the 
rate  of  expenditure  Is  free  to  vary  over  the  renge  xero  to  E  without 

MX 

altering  the  production  function  for  product  Improvement.  In  fact  the 
rate  of  expenditures  can  make  discontinuous  jumps  in  that  range  effort¬ 
lessly.  This  assumption  Is  acceptable  only  If  It  is  believed  that  the 
costs-of-adjustment  associated  with  charges  in  E(t)  are  negligible  in 
the  range  zero  to  E^.  Put  another  way,  our  assumption  Is  reasonable 
if  we  believe  that  once  a  managerial  base  has  been  established  it  is 
relatively  easy  to  make  adjustments  within  the  capacity  of  that  base  but 
that  adjustments  beyond  the  capacity  of  Che  managerial  base  can  only  be 
made  at  a  cost. 

Suppose  at  various  times  known  in  advance,  E  can  be  changed  but 
with  a  cost-of-adjustment  dependent  on  the  size  of  the  change  being  in¬ 
curred.  It  Is  clear  that  E _  would  never  be  lowered  voluntarily  since 

that  would  not  add  options  and  would  Involve  a  positive  cost.  Hence, 

E _  would  only  be  Increased,  a  larger  E  _  making  a  larger  program  with 

more  personnel  and  more  specialization  possible.  The  cost-of-adjustment 
to  a  higher  E^  arises  from  the  necessity  to  expand  the  managerial  base 
and  to  Improve  Intra-project  communication  and  coordination  stemming 
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froa  the  greater  number  of  personnel  and  increased  degree  of  special¬ 
isation. 


The  question  is  than  how  should  be  controlled  to  yield  a 
higher  value  of  the  objective  function  in  maximum  problem  (5).  The 
answer  can  ba  found  by  solving  a  combination  continuous-discreet  dynamic 
programming  problem. 

For  simplicity  let  p*  -  6  and  define 

(37)  V(r,  E..J  -  max  £  (U(<p(X))  -  E(t))e“6tdt 

subject  to 

(a)  X(t)  -  E(t) 

(b)  E^  -  E(t)  >  0 

(c)  X(t)  -  XT 

(d)  E(t)  £  0 

Let  C(E»ma^  -  EMM)e~8T  be  the  present  discounted  value  of  the 

costs-of-sdjustaent  from  E  to  E* _ .  If  there  la  just  one  time  t  at 

max  max 


which  a  decision  to  change  E  can  be  made,  then  we  need  only  compare 


v<°,  K  >  with  sup  IV(t,  E*  )  -  C(B*  -  B  )e  0T] .  The  optimal 
mu 


policy  is  to  stick  with  E  if  ths  former  expression  is  greater  or  the 

MI 

same  and  to  switch  to  some  E*  _  if  the  latter  is  greater. 

MX 

If  there  are  several  such  decision  points  T_n>  T_n|^ . t_^,  tq. 


f<Tx)  -  MX  If <•»!_!>, t sup  [V(Ti,  E*^)  -  CCE^-E^Je^n 


i  -  -n,  -n+1,  ....  -1,  0,  where  f(t_n_1>  ■  V(0,  E^fly)  is  given  since 
E^,^  is  given.  Using  this  formulation  the  optimal  program  can  be  found 
by  the  traditional  techniques  of  dynamic  programming. 


i  kmm  wmm 
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If  V(t,  E  )  la  con cava  with  raapact  to  E 


12 

’auu  and  C  la  atrlctljr 
convex  with  raapact  to  lta  argument,  than  chaagaa  in  tha  optlaal  value  of 
E  ,  If  any,  will  be  finite. 


^Bacall  n(t)  -  -1  +  n(t)  la  tha  loaa  at  tine  t  due  to  coaatralnt 
(5b).  Tha  total  loaa  aaaodatad  with  a  finite  1M>  la  given  by: 

(I)  /J*  Tt(t)dt  where  T*  -  X*/Em^. 

Differentiating  with  raapact  to  B,.,, 

(II)  4s - /I*  n(t)dt  •  — *■  tt(T*)  ♦  /I*  IS —  dt  <  0 

“■a*  0  (E _ j  0  *  max 


alnce  tr(T*)  •  0  and  - <  0  for  tc  [0,T*]. 


Hence  the  value  of  V  aaiat  lncreaae  aa  increaaea 
Similarly  the  aecond  derivative 
,2 


«“»  ■  fo  „ 


T*  dt  ^  poeitive  If 

9B* 


can  be 


ahown  to  be  poaltive  for  tc[0,T*].  This  would  complete  the  proof  of 
the  concavity  of  V. 
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